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Abstract. We construct a generalization of the Hasse invariant for certain 
unitary Shimura varieties of PEL type whose vanishing locus is the comple- 
ment of the so-called ^t-ordinary locus. We show that the ^t-ordinary locus of 
those varieties is affine. As an application, we strengthen a special case of a 
theorem of one of us (W.G.) on the association of Galois representations to 
automorphic representations of unitary groups whose archimedean component 
is a holomorphic limit of discrete series. 



1. Introduction 

Starting with the cornerstone work of Dcligne-Serre |DS74) on classical weight 
one modular forms, the Hasse invariant has been a fundamental tool for constructing 
congruences between automorphic forms. In turn, the congruences that arise from 
the Hasse invariant have been used to construct automorphic Galois representations 
that do not appear directly in the etale cohomology of Shimura varieties ( |Tay91| , 
|Goll2j ). One limitation of the Hasse invariant is that there exist many Shimura 
varieties for which the Hasse invariant is identically zero. This happens precisely 
for those Shimura varieties whose ordinary locus is empty. 

The ^-ordinary locus introduced by Rapoport and Richartz [RR96j can be viewed 
as a substitute to the ordinary locus when the latter is empty. Indeed a theorem 
of Wedhorn states that, for a prime of good reduction and hyperspecial level, the 
/^-ordinary locus is dense |Wed991 Th.1.6.2]. It is therefore natural to seek a gen- 
eralization of the Hasse invariant whose vanishing locus is the complement of the 
/^-ordinary locus. Wc construct such an invariant for Shimura varieties Sh(G,X) 
of PEL-type such that G(R) is isomorphic to a unitary similitude group GU(a, b) 
for some positive integers a, b. This class includes Picard modular varieties. 

1.1. Main Result. Suppose U = (B,V,* <,>,h) is a Kottwitz datum, with as- 
sociated Shimura variety Sh(G,X) (see [Goll2| §3.1]) such that the center of the 
simple Q-algebra B is an imaginary quadratic field F. Let I be a prime of good 
reduction for U (see loc. cit. §3.3) and /C^ C G(A^) an open compact subgroup. 
Let Sh K (t) £ be the Kottwitz integral model of Sh(G,X.) at level K.^ (see loc. cit. 
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§3.4]). Let E = E(G, X) be the reflex field of Sh(G, X) and A a prime of E lying 
above £. Denote by sh^t) \ the special fiber of Sh^tt) # at A . 

Theorem 1.1 (/i-ordinary Hasse invariant). There exists an automorphic line bun- 
dle ^ujfcte), and a section G H° (sh^t) ^^uj®^ ^) such that: 

(//-Hal) The non-vanishing locus of is the /i-ordinary locus of sh^e, \ . 
(/x-Ha2) There exists an integer m G N such that (^H)" 1 lifts to characteristic zero. 
(/i-Ha3) The construction of is compatible with varying the level K.^ . 

Corollary 1.2. The pL-ordinary locus sh^T^ 1 ^'™™ in the minimal compactification 
s ^kM) a * s a ffi ne - 

Remark 1.3. We do not know the minimal value of m in (/j,-Ha2). The Hasse 
invariant of Siegel varieties lifts i.e., m = 1, see [BN07| . 

1.2. Application. Let U be as in §1.11 Suppose 7r is a cuspidal automorphic 
representation of G(A) with p-adic component tt p for every (rational) prime p. 
Given a (rational) prime £, let be the set of (rational) primes p different from £ 
such that TT p is unramified and G is unramified at p. Let be the set of primes 
of F that are split and lie over some p G 

Assume p G One has a decomposition G(Q P ) = Q* x GL(n,F p ), where 

n is given by n 2 = dimp EndsV^. Write ir p = Xp <S> with Xp a character of Q* 
and tt p a representation of GL(n, F p ). 

Our result on Galois representations is: 

Theorem 1.4. Suppose n is a cuspidal automorphic representation o/G(A) whose 
archimedean component is an ~X.-holomorphic limit of discrete series represen- 
tation o/G(R) (see |Goll21 §2.3]J. Assume £ is a prime (of Q) of good reduction 
for IA. Then there exists a unique semisimple Galois representation 

(1) RiM) ■ Gal(F/F) — > GL(n,Q,) 
satisfying the following two conditions: 

(Gall) If p £ V^' and p is a prime of F dividing p then Ri tL (n) is unramified at 

p. In particular Ri ^Tt) is unramified at all but finitely many places. 
(Gal2) If p £ ' then there is an isomorphism of Weil-Deligne representations 

(2) (R^{tt)\ Wf J s = i - 1 rec(7r p ® \ ■ \^f), 

where Wf is the Weil group of F p , the superscript ss denotes semi-simplification 
and rec is the Local Langlands Correspondence, normalized as in Harris- 
Taylor [HTOlj . 

Remark 1.5. Comparison with |Goll2[ Th. 1.2.1]. The improvement in Th. 11.41 
with respect to loc. cit. is the removal of the assumption that some prime A of E 
above £ is split in E. 

2. Construction of the //-ordinary Hasse invariant 

Assume henceforth, without loss of generality, that a < b. The assumption that 
£ is a prime of good reduction for 1A implies that £ is unramified in E. 
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If A is split in E, Th. ED is well-known (see e.g., |Goll2| §4]). If a = b then 
E = Q, so A is necessarily split in E. Hence we assume from now on that a < b 
and that A is inert in E. 

As in |Goll21 §3.7], the Hodge bundle fi^W decomposes as 

(3) n KW =n!Fi>, ® n jcw,*' 

where fij^m a (resp. Q^OT b ) has rank a (resp. b) and r is the rank of B over F. 
Let w t (() a (resp. b ) be the determinant of Cl^w a (resp. f2 K («j b ). 

Let A be an abelian scheme representing the universal isogeny class above 
sh/cw \ As in (4.6) of loc. cit. , the Verschiebung Vcr : A^ — > A induces a map 

(4) Ver*:n KW ^og„. 

Since A is inert, the restrictions of Ver* to f2^(«) a (resp. b ) have the form 

( 5 ) Ver *n K (0, o : n «(0,o — ► fi lm,b and Ver rn K(f)ib : — ► ^«), a - 
Therefore, if (Ver*) 2 denotes the composite of Ver* with itself, then we have 

(6) ( Vcr % K( o,„ : ^,a— >ng. 

Let 

(7) ^):^). Q ^^ 2) a , 



be the top exterior power of that map, where we have used that w^. (<) q 
since u>^(.t) a is a line bundle. The map M /i(.4) induces a global section 



(8) m{A)eH°{sh KWiX ,^ ) - 1) ). 

If £> is another representative of the universal isogeny class above sh^w x an d 
if : A — > B is an isogeny compatible with the endomorphism actions of A, B, then 
as in [Goll~2"l §4.2], the compatibility of Verschiebung with isogenies (Lemma 4.2.3 
of loc. cit.) implies that ip*(^H(B)) = ^H(A). Hence we may omit reference to the 

representatives A or B and we have a section 6 H°(sh K (e) a ,cj® ( ^ ~ ), which 
we call the /x-ordinary Hasse invariant . 

3. Proofs. 

We begin with the proof of Th. 11.11 The following two lemmas and their corol- 
laries will establish that satisfies (/x-Hal). 

Lemma 3.1. The Newton polygon J\f md of the underlying isogeny class of abelian 
schemes of a ^.-ordinary geometric point of sh^t) \ has the following slopes: 

~) ( 2ar 

1/2 > with multiplicity < 2(6 — a)r 

1 J [ 2ar 

Proof. The case r = 1 follows from Wcd99, 2.3.2]. The case of general r follows 
subsequently from |Moo04| 1.3.1 and 3.2.9]. □ 



Proposition 3.2. The ^-ordinary locus is the maximal £-rank stratum of sh 
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Proof. The key point is that, by |RR96| Prop. 2.4(iv) and Th.4.2], the Newton 
polygon J\f old described in Lemma l3~Tl is the lowest among the Newton polygons of 
the underlying isogeny classes of abelian schemes corresponding to geometric points 
of sh K (i) A . Let A be an abelian scheme with Newton polygon Af(A). Then Af(A) 
is symmetric and the ^-rank of A is the multiplicity of (=the multiplicity of 1) 
as a slope of Af(A) . But if the multiplicity of in AT (A) is at least the multiplicity 
of in VV ord and Af(A) lies on or above J\f ord , then by Lemma [3.11 we must have 
M{A) = M ord . □ 

Corollary 3.3. The maximal (-rank stratum of sh^t) \ has (.-rank 2ar. 

Proof. This follows directly from Lemma T3. II and the proof of Prop. |3~21 □ 

Lemma 3.4. Suppose A is an abelian scheme which is a representative of the 
underlying isogeny class of a geometric point of shtc,\. Then ^H(A) ^ if and only 
if the (-rank of A is equal to 2ar. 

Proof. One has Oa) = H°(A, and under this isomorphism the action 

of Frobenius on H 1 (A,Oa) corresponds to that of Verschiebung on H°(A,il A ). 
Hence |Mum08|, §15] implies that the £-rank of A equals the semisimple rank of 
(Ver*)J : Q -> fi^) for all j E N. Since dim A = (a + b)r, keeping in mind ([3]) 
and using the last corollary of §14 of loc. cit., (Vcr*)- 7 is semisimple for j > a + b. 
Therefore the ^-rank of A equals the rank of (Ver*)-? for j > a + b. We take the 
®(o + b) iterate of the section ^H(A), see ©. It is clear that ^H(A) ^ if and 
only if ^H(A) n ^ for any n <E LiV>o, in particular for n = a + b. 

Since a < b, both Vcrf and Verfo have rank at most a. So also 

(Vcr*)-? and (Vcr*)^ each have rank at most a. By ©, (Vcr*)- 7 has rank 
at most 2ar. 

The €-rank of A equals 2ar if and only if the rank of (Ver*)-? is 2ar for j > a + b. 
In turn, the rank of (Vcr* V is 2ar if and only if both Vcrf and Vcrf have 

rank a. Since ^^:< ? ),a an d ^Jc(^) a are ran k a vector bundles, the determinant of 
a map between them is nonzero if and only if it has rank a. □ 

We now conclude the proof of Th. 11.11 

Proof of Th. 11.11 Combining Prop. 13.21 Cor. l3.3l and Lemma 13.41 gives f^t-Hal). By 
|LS12bl Prop. 7.14] (or [LS12a in the compact case), there exists k S N such 

that Wfc(e) a extends to an ample line bundle on the minimal compactification 
s/iwj) A - Given this ampleness result, the existence of a lift of some power of 
follows by a well-known cohomological argument coupled with the Koecher principle 
(cf. |Goll2| Lemma 4.4.1]). Thus (/i-Ha2) is established. Finally (/i-Ha3) is proved 
in the same way as Th.4.2.4 of loc. cit.. □ 

Next we note that Cor. 11.21 is an immediate consequence of Th. 11.11 



Proof of Cor. 11.21 The nonvanishing locus of a section of an ample line bundle on 
a projective scheme is affinc. □ 



Finally we note how Th. 11.41 follows from Th. 11,11 
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Proof o/Th.O The proof is analogous to the proof of |Goll2| Th.1.2]: Let K C 
G(A/) be an open compact subgroup such that K, = K^K^ with £W c G(Ay) 
and Km C G(Z^). Let Sh/c,E be the model of Sh(G,X) at level /C over E as 
defined in §3.2 of loc. cit.. Let Shx.,e be the normalization of Sh^t) c in Sh/c,E- 
Let 7T : Sh)c,i — > Sh^t) ^ be the natural projection. 

Using (jtt-Ha2), let be a lift of a power "if and let "F^ ft be the pullback 

of to S/ijc,£ along the projection 71". 

Let 'H = %p^)(G,Z^) be the spherical Hecke algebra of G with values in Z^, 
trivial at places outside (see §6.1 of loc. cit. for a more detailed definition). 

Theorem 3.5. Suppose V is an automorphic vector bundle on Shx.,1 and f G 
H°(Sh)c j,V) is nonzero modulo A. Then for all j G N, the product (^H^ 1 )^ f G 
H°(Sh)cj,LUfc^ 1 ^ ® V) is nonzero modulo A and satisfies 

(9) T^H^ff) = ("H^fTif) (mod A J+1 ) /or aZZ T eH. 

Proof. Since the /i-ordinary locus is dense [Wed99, Th.1.6.2], the product (vjfj&y 3 j 
is nonzero modulo A by (/i-Hal). As in the proof of }Goll21 Th.6.2.1], (/i-Ha3) 
implies ©• □ 

Given Th. 13.51 the remainder of the argument to establish Th. II .41 is identical to 
§§6.3-6.4 of loc. cit.. □ 

Remark 3.6. A tremendous advantage of our ^-ordinary Hasse invariant is that 
it satisfies all key properties of the classical invariant. Its applications will thus 
follow the classical blueprint: to Galois representations (as we illustrated briefly 
above), but also immediately the (non-effective) existence of its canonical subgroup 
thanks to the elementary [Far 111 Prop. 3], and thus also applications to explicit 
constructions of eigenvarieties, etc. 
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